Methods, apparatus, and systems for providing media content over a communications network

ABSTRACT

The present invention relates to broadcasting/multicasting of media content over a communication network using shared bandwidth available from peer-to-peer networking. The system of the present invention includes a plurality of broadcast devices, a plurality of receiving devices, a plurality of databases, and a control center. The control center provides a number of services, including but not limited to channel control, ad insertion, conditional access, program guide services, and the like. The broadcast device converts media content, which can be television, radio, and other data, received from various content providers, into digital data packets, having a suitable format for transmission. Each receiving device will request the relevant packets, decode the received packets, and display or present the media content contained in the packets via an associated device. Packets may be received directly from the broadcast devices or from peers (other receiving devices) on the network.

This application is a continuation of commonly owned, U.S. applicationSer. No. 11/704,701 filed on Feb. 9, 2007 (now U.S. Pat. No. 8,904,456),which claims the benefit of U.S. Provisional Application No. 60/773,209filed on Feb. 13, 2006, each of which is incorporated herein byreference in their entirety and for all purposes.

BACKGROUND OF THE INVENTION

The present invention relates to the provision of media content, such astelevision services, over a communications network, such as theInternet. More specifically, the present invention relates tobroadcasting/multicasting of media content over the Internet usingshared bandwidth available from peer-to-peer networking.

Traditional broadcast television services are provided over dedicatedbroadcast channels that require large amounts of bandwidth andbroadcasting resources. Traditional television networks also havechannel count limits imposed by bandwidth availability of thetransmission medium.

The present invention provides advantages over the existing broadcasttelevision mediums, such as terrestrial, cable and satellite mediums. Inparticular, the present invention provides a global broadcastingtelevision service which uses existing broadband resources to reach aglobal audience—potentially 170 million households and growing. Thepresent invention enables anyone with an existing high-speed Internetconnection to receive live digital broadcast-quality television programsanywhere in the world on an existing television or other suitable videoappliance or display. The present invention provides a program-rich,feature-rich, and cost-effective alternative to traditional cable orsatellite television services. Content management and encryptiontechnology is also provided, so that all content provided via thepresent invention is traceable and protected.

Unlike traditional television networks, which are constrained bygeographic boundaries, the television services provided by the presentinvention are accessible globally, and are limited only by theavailability of a broadband network connection. Moreover, the presentinvention is capable of supporting an unlimited number of channels,which is not possible with conventional broadcast, satellite or cabletelevision systems.

The present invention is also advantageous in that it uses the Internet,and does not require the construction of any new infrastructure. Inaddition, the present invention enables content providers to delivertheir programs with low cost real-time servers and affordable (severalmegabits) Internet connections. Such capabilities result in adramatically reduced carrying cost for the system as compared totraditional cable and satellite television systems.

In addition, unlike prior art IP-based video streaming technology whichdedicates a certain amount of server resource and bandwidth for eachviewer, the present invention enables a low cost server with limitedbandwidth serving an unlimited number of viewers. With a set-top box inaccordance with the present invention, viewers can view the televisioncontent on a television, in addition to viewing on a computer. In anillustrated embodiment, the set-top box provides an interface between anInternet connection and a television. The video quality provided usingthe teachings of the invention is equal to or better than that seen ontypical digital cable television channels.

The methods, apparatus, and systems of the present invention provide theforegoing and other advantages.

SUMMARY OF THE INVENTION

The present invention relates to broadcasting/multicasting of mediacontent over a communications network using shared bandwidth availablefrom peer-to-peer networking.

The system of the present invention may include a plurality of broadcastdevices, a plurality of receiving devices, a plurality of databases, anda control center.

The broadcast device converts real time or non-real time media content,which can be television, radio, and other data received from variouscontent providers, into digital packets having a suitable format fortransmission over the Internet. Each receiving device willrequest/receive the relevant packets, decode the received packets, anddisplay the media content contained in the packets on an associatedtelevision or other video appliance or display.

The present invention provides a distributed application-levelIP-multicasting (or peer-to-peer) network. Each receiving device on thenetwork not only receives packets for its own consumption, but may alsoserves packets to be received and used by other receiving devices. Thispeer-to-peer feature is referred to as Mediashare™ (discussed in detailbelow), and enables a thin server with limited bandwidth to serve anunlimited number of receiving devices in real time.

The control center is the central nerve of the network, and provides anumber of services, including but not limited to:

-   -   1. Channel service: provides authorization for a broadcast        device to broadcast; creates a channel line up;    -   2. Guide Service; informs the receiving devices what programs        are available on each channel;    -   3. User service: provides necessary authorization of viewing        content;    -   4. Conditional Access service: dispenses encryption keys for a        broadcast device to encrypt its content and decryption keys for        the receiving devices to decrypt the encrypted content;    -   5. Peer service: informs receiving devices where to find their        peers;    -   6. Billing service: creates billing according to user        subscription and user behaviors; and    -   7. Ad service: allows advertising content to be distributed and        informs receiving devices when to switch to a commercial and        when to switch back.

The present invention encompasses a number of innovations created toenable a television service on such a peer-to-peer platform. Theseinnovations include, without limitation:

-   -   1.™—Enables a channel to carry multiple streams.    -   2. MediaSwitch™—provides a quick channel/program switch that        television viewers are accustomed to.    -   3. MediaShare™—provides an effective way to share bandwidth        among users (peers).    -   4. MediaCluster™—provides for efficient clustering of the peers        for optimum network usage.    -   5. MediaSplice™—provides for splicing or switching of the video        stream for ad insertion.    -   6. MediaOverlay™/MediaSubaudio™—provides for logo and subtitle        overlays, including translations of audio and text from one        language into a desired/local language of the receiver.    -   7. MediaCrypt™—provides content protection demanded by content        broadcasters.

In one example embodiment of the present invention, methods and systemsare provided for delivering media content over a communications network.One or more servers are provided for delivering media content over thenetwork for one or more media content programs. The media contentcomprises data packets. A control center is provided for controllingdelivery of the media content over the network via the one or moreservers. A plurality of receiving devices are provided for receiving themedia content. At least a portion of the receiving devices areconfigured to share resources via the network, enabling the transfer ofthe data packets from one receiving device to another.

The media content may be reconstructed at the receiving device in realtime with data packets received from at least one of: (a) one of theservers; (b) one or more peers on the network; and (c) local memory.

The one or more servers may comprise at least one of: (a) one or morededicated broadcasting devices; and (b) one or more of the receivingdevices. In other words, data packets for a media content program may beprovided to a receiving device from a dedicated broadcasting device oranther one of the receiving devices.

The MediaSwitch component of the present invention enables a programswitch from a first program to a second program. For example, a firstreceiving device may be receiving data packets for a first media contentprogram. The first receiving device is enabled to switch to a secondmedia content program by receiving data packets for the second mediacontent program from at least one of: (a) one of the one or moreservers; and (b) at least one other of the receiving devices currentlyreceiving data packets for the second media content program.

The data packets initially received for the second media content programduring a program switch may comprise one or more anchor frames for thesecond media content program. Alternatively, the data packets initiallyreceived for the second media content program during a program switchmay comprise one or more anchor frame and corresponding audio data forthe second media content program. The one or more anchor frames arereceived for the second media content program until the first receivingdevice has sufficient bandwidth to receive data packets containingadditional anchor frames and other types of frames.

In a further example embodiment, a peer service is provided which isassociated with the control center for defining a subset of thereceiving devices that comprise peers on the network. The transfer ofthe data packets is enabled from one peer to another peer.

In such an example embodiment, the MediaSwitch component of the presentinvention may enable a program switch using data packets obtained frompeers on the network. For example, a first receiving device may bereceiving data packets for a first media content program. The firstreceiving device processes a program switch from the first media contentprogram to a second media content program. Data packets for the secondmedia content program are provided to the first receiving device from atleast one of: (a) one of the one or more servers; and (b) at least oneof the peers on the network.

A request for the program switch may be communicated from the firstreceiving device to the peer service. The peer service may provide tothe first receiving device a list of available peers on the network thatare currently receiving the data packets for the second media contentprogram. During processing of the program switch, the first receivingdevice may communicate a request for the data packets for the secondmedia content program to one or more of the available peers from thelist. The request for data packets may comprise a request for anchorframes from the second media content program.

A number of anchor frames may be stored at each receiving device forenabling the program switch. The request may include a request for aninitial anchor frame closest to a display time of the receiving device.The initial anchor frame may be an anchor frame with a time-stampclosest to a time t plus a current time. The time t may comprise one ofa positive number, a negative number, and zero.

The initial anchor frame may be received, decoded, and displayed at thefirst receiving device regardless of a time stamp for the initial anchorframe. The first receiving device may begin receiving additional anchorframes after the initial anchor frame is received. The additional anchorframes may be received from one or more of the peers until the firstreceiving device has sufficient bandwidth to accept data packetscontaining additional anchor frames and other types of frame.

The first receiving device may communicate a stop command to the serverproviding the data packets for the first media content program after theprogram switch is processed.

The one or more servers may segregate the media content into groups ofdata packets according to priority, including at least a high prioritygroup of data packets and a low priority group of data packets. The highpriority group of data packets for the second media content program areprovided to the first receiving device to enable the program switch. Thehigh priority group of data packets may comprise anchor frames andassociated audio packets, and the lower priority group of data packetsmay comprise non-anchor frames and associated audio packets.

The media content may comprise at least one of prerecorded media contentor real-time media content. The media content may comprise at least oneof television programs, news programs, movies, concerts, sportsprograms, radio programs, advertising content, television commercials,radio commercials, and the like.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will hereinafter be described in conjunction withthe appended drawing figures, wherein like reference numerals denotelike elements, and:

FIG. 1 is a block diagram of an example system embodiment in accordancewith the present invention;

FIG. 2 is a block diagram of a further example system embodiment inaccordance with the present invention;

FIG. 3 is a flowchart of an example embodiment of the MediasSwitch™feature in accordance with the present invention;

FIG. 4 is a block diagram of a prior art isolated peer-to-peer network;

FIG. 5 is a block diagram of an example embodiment of a sharedpeer-to-peer network in accordance with the present invention;

FIG. 6 is a flowchart of an example embodiment of the MediaShare™feature in accordance with the present invention;

FIG. 7 is a flowchart of an example embodiment of the MediasSplice™feature in accordance with the present invention;

FIG. 8 is a block diagram of an example embodiment of the MediaOverlay™and MediaSubaudio™ features in accordance with the present invention;and

FIG. 9 is a flowchart of an example embodiment of the MediaOverlay™ andMediaSubaudio™ processes in accordance with the present invention.

DETAILED DESCRIPTION

The ensuing detailed description provides exemplary embodiments only,and is not intended to limit the scope, applicability, or configurationof the invention. Rather, the ensuing detailed description of theexemplary embodiments will provide those skilled in the art with anenabling description for implementing an embodiment of the invention. Itshould be understood that various changes may be made in the functionand arrangement of elements without departing from the spirit and scopeof the invention as set forth in the appended claims.

FIG. 1 shows an example embodiment of a system 10 in accordance with thepresent invention. The system includes a control center 12, a pluralityof broadcast devices/encoders 14, a plurality of receiving devices(e.g., set-top boxes) 16, and a network 18 (e.g., the Internet or otherglobal communications network). In addition, software may be provided toenable a PC 20 or a laptop 22 to act as a receiving device for receivingcontent from the network or as a broadcast device for providing contentto the network (e.g., via video camera 21).

Although example embodiments of the present invention are described inconnection with delivery of television services over the Internet, itshould be appreciated that the present invention can be adapted for usewith any type of media content on any type of communications network.For example, the network 18 may be a local area network (LAN),metropolitan area network (MAN), a wide area network (WAN), an intranet,and a global area network, or combinations thereof.

As shown in FIG. 1, each broadcast device 14 may be associated with adifferent content provider, such as CNN, France Television, Live SoccerTV, or the like.

As shown in FIG. 2, the control center 12 can provide various services,including, for example, a channel service 30, which providesauthorization for a broadcast device 14 to broadcast and creates achannel line up; a guide service 32, which informs the receiving devices16 what available channels/programs are present on the network; a userservice 34, which provides necessary authorization of viewing content; aconditional access (“CA”) service 36, which dispenses encryption keysfor the broadcast devices 14 to encrypt their content and decryptionkeys for the receiving devices 16 to decrypt the encrypted content; apeer service 38, which informs receiving devices 16 where to find theirpeers on the network 18; a billing service 40, which creates billingaccording to user subscription and user behaviors; and an ad insertingservice 42, which allows advertising content to be distributed andinforms receiving devices 16 when to switch to a commercial and when toswitch back to a regular program or service.

Each of the foregoing services may have an associated database forstoring relevant information used by that service. For example, thechannel service 30 may have an associated channel database 31 forstoring records relating to available programs and correspondingchannels on the network and channel lineups; the guide service 32 mayhave an associated guide database 33 for storing information used tocreate the program guides and the guides themselves; the user service 34may have an associated user database 35 for storing records associatedwith each user, including authorization information; the conditionalaccess service 36 may have an associated key database 37 for storing theencryption and decryption keys; the peer service 38 may have anassociated activity database 39 for storing records relating to theactivity of each user; the billing service 40 may have an associatedbilling service database 41 for storing records relating to billing ofusers; and the ad service 42 may have an associated ad database 43 forstoring advertisements, messages, public service announcements and thelike to be inserted into the content. Those skilled in the art willappreciate that, although the databases are shown as part of the controlcenter 12 in FIG. 2, one or more of these databases may be locatedremote from the control center 12 and connected thereto via the network18.

The broadcast device 14 may comprise an encoder 50 for encoding thecontent provided by the content provider and a transmitter 52 fortransmitting the encoded content over the network 18 via a particularchannel 54. The channel 54 may be assigned by the channel service 30.

The receiving device 16 may comprise a receiver 56 for receiving thecontent from the network 18 on a particular channel 54 and a decoder 58for decoding the content for display on an associated television orother video appliance or display 19, a laptop 22, or a PC 20 (FIG. 1).It should be appreciated that any receiving device 16 may also includethe functionality of the broadcast device 14 (e.g., an encoder 50 andtransmitter 52) to enable the receiving device 16 to act as a broadcastdevice 14 to enable transfer of data packets among peers on the network.

In one example embodiment of the present invention, methods and systemsare provided for delivering media content over a communications network(e.g., network 18). One or more servers are provided for deliveringmedia content over the network 18 for one or more media contentprograms. The one or more servers may comprise at least one of: (a) oneor more dedicated broadcasting devices 14; and (b) one or more of thereceiving devices 16. In other words, data packets for a media contentprogram may be provided to a receiving device from a dedicatedbroadcasting device or anther one of the receiving devices.

The media content comprises data packets. A control center 12 isprovided for controlling delivery of the media content over the network18 via the one or more servers. A plurality of receiving devices 16 areprovided for receiving the media content. At least a portion of thereceiving devices 16 are configured to share resources via the network18, enabling the transfer of the data packets from one receiving deviceto another. This transfer of packets from one receiving device 16 toanother is discussed in detail below in connection with the MediaSharefeature of the present invention.

The media content may be reconstructed at the receiving device in realtime with data packets received from at least one of: (a) one of theservers; (b) one or more peers on the network; and (c) local memory.

MediaTorrent™

The MediaTorrent™ feature uses IP multicasting to deliver data packetsto as many receiving devices as possible, and uses the peer-to-peernetwork to find and deliver missing packets. The server (e.g.,broadcasting device 14 or a server associated therewith) will providethe IP multicasting information and tracking information to all thereceiving devices 16 requesting the media content. All the receivingdevices 16 will attempt to subscribe to the IP multicasting channelidentified in the multicasting information. Any receiving devices 16that fail to connect to the IP multicasting channel will use thetracking information to obtain the media content, or missing packetsthereof, from peers connected to the network 18 (other receiving devices16) that have been able to connect to the IP multicasting channel. Themedia content may be segregated into multiple independent groups. Eachgroup may be assigned a different priority. The receiving device willattempt to first receive the packets that are assigned a higherpriority.

In an example embodiment, at least some of the receiving devices 16 areable to create a new IP multicasting channel and to send out all theinformation received at that receiving device 16 to other receivingdevices via the network 18.

MediaSwitch™

The MediaSwitch™ feature of the present invention provides users withthe ability to make a quick program switch in an IP environment. One ofthe challenges in implementing a broadcast television system over theInternet or other type of network is to enable a user to quickly switchfrom one program to another as can be done with traditional televisionservices. Normally, in an IP environment, a certain amount of content,say T seconds, is buffered at the receiver in response to a request forthat content. This often means that the decoder will not show thecontent until T seconds later.

The MediaSwitch™ feature allows a decoder to intelligently requestproper data packets for the new program from its peers in the network.With the available bandwidth and peers' support, the first frame for anew program (and associated audio data) can be provided to the receivingdevice within 100 ms. This enables a user to quickly switch to a newprogram, avoiding the delays associated with a typical prior art IPenvironment. The basic idea behind the MediaSwitch™ feature is thatvideo data can be separated into an anchor frame and other frames. Ananchor frame (e.g., an I-Frame in the MPEG format) is a frame that canbe decoded without needing information from other frames.

In an example embodiment of the MediaSwitch feature in accordance withthe present invention, a first receiving device 16 may be receiving datapackets for a first media content program. The first receiving device 16is enabled to switch to a second media content program by receiving datapackets for the second media content program from at least one of: (a)one of the one or more servers 14; and (b) at least one other of thereceiving devices 16 currently receiving data packets for the secondmedia content program.

The data packets initially received for the second media content programduring a program switch may comprise one or more anchor frames for thesecond media content program. Alternatively, the data packets initiallyreceived for the second media content program during a program switchmay comprise one or more anchor frames and corresponding audio data forthe second media content program. The one or more anchor frames may bereceived for the second media content program until the first receivingdevice 16 has sufficient bandwidth to receive data packets containingadditional anchor frames and other types of frames.

In a further example embodiment, a peer service 38 is provided which isassociated with the control center 12 for defining a subset of thereceiving devices 16 that comprise peers on the network 18. The transferof the data packets is enabled between the peers.

In such an example embodiment, the MediaSwitch component of the presentinvention may enable a program switch using data packets obtained frompeers on the network 18. For example, a first receiving device 16 may bereceiving data packets for a first media content program. The firstreceiving device 16 processes a program switch from the first mediacontent program to a second media content program. Data packets for thesecond media content program are provided to the first receiving device16 from at least one of: (a) one of the one or more servers (e.g.,broadcast devices 14 or other receiving device 16 acting as a server);and (b) at least one of the peers (e.g., other receiving devices 16 onthe network 18).

A request for the program switch may be communicated from the firstreceiving device 16 to the peer service 38. The peer service 38 mayprovide to the first receiving device 16 a list of available peers onthe network 18 that are currently receiving the data packets for thesecond media content program. During processing of the program switch,the first receiving device 16 may communicate a request for the datapackets for the second media content program to one or more of theavailable peers from the list (any other receiving device 16 identifiedby the peer service 38 as a peer that is receiving the second mediacontent program).

The request for data packets may comprise a request for anchor framesfrom the second media content program. The request may include a requestfor an initial anchor frame closest to a display time of the receivingdevice 16. The initial anchor frame may be an anchor frame with atime-stamp closest to a time t plus a current time. The time t maycomprise one of a positive number, a negative number, and zero.

The initial anchor frame may be received, decoded, and displayed at thefirst receiving device 16 regardless of a time stamp for the initialanchor frame. The first receiving device 16 may begin receivingadditional anchor frames after the initial anchor frame is received. Theadditional anchor frames may be received from one or more of the peersuntil the first receiving device 16 has sufficient bandwidth to acceptdata packets containing additional anchor frames and other types offrame.

The first receiving device 16 may communicate a stop command to theserver providing the data packets for the first media content programafter the program switch is processed.

The media content may comprise at least one of prerecorded media contentor real-time media content. The media content may comprise at least oneof television programs, news programs, movies, concerts, sportsprograms, radio programs, advertising content, television commercials,radio commercials, and the like.

FIG. 3 is a flow diagram of an example embodiment of the MediaSwitch™process. The receiving device 16 may be receiving/downloading datapackets for a first media content program when it receives a request toswitch to a second media content program (step 101). The receivingdevice 16 may be receiving data packets for the first media contentprogram from either the broadcast device 14 or connected peers (otherreceiving devices 16) that are also receiving the first media contentprogram. Once a program change request is received, the receiving device16 may request the first available anchor frame and audio data (step102) from peers (other receiving devices 16) which are tuned to thechannel that decoder is switching into. Optionally the data packets forthe second media content program may be received from a server 14. Therequest may be processed by peer service 38 at control center 12 (FIG.2). The peer service 38 receives the program change request (step 103)and sends a list of peers which have data from the second media contentprogram to the receiving device 16 (step 104). The receiving device 16may then send a STOP command to currently connected peers and/or servers14 (step 105) in order to stop peers and/or servers 14 from providingthe data packets for the first media content program to the receivingdevice 16 (since the receiving device 16 is switching away from thefirst media content program). It should be noted that stop commands canbe issued at any time, from the moment of receiving the channel switchand onwards.

The receiving device 16 may then send a request (step 106) for an anchorframe, which can be the nearest available anchor frame for the displaytime, and associated audio data to peers on the list provided by thepeer service 38 (step 104). When the receiving device 16 completelyreceives the first requested anchor frame data, it may then be decoded(step 107) and displayed regardless of its time stamp set by thebroadcast equipment. Associated audio data may be decoded according toits time stamp. The receiving device 16 may continue to receivesubsequent anchor frames and audio data, until the receiving device 16has extra bandwidth for additional anchor frames and other types offrames (e.g., B and P frames in the MPEG format) at which time thenormal receiving process will resume (step 108).

The right side of FIG. 3 shows the buffer timeline 120 of the receivingdevice 16 during the switch from the first media content program(Program 1) to a second media content program (Program 2), and thedecoding and display timeline 122 of the buffered data at receivingdevice 16.

With the MediaSwitch™ feature, the server (e.g., broadcast device 14, aserver associated with the broadcast device 14, or a peer on thenetwork) may segregate the media content into groups of data packetsaccording to priority, including at least a high priority group of datapackets and a low priority group of data packets. During channelswitching, the receiving device 16 has the first priority of requestingdata from the high priority group or groups of content to enable theprogram switch. The decoder 58 of the receiving device 16 will decodedata from the high priority group/groups received from a server 14 orpeers receiving the second media content program that the receivingdevice 16 is switching to. Once the receiving device 16 receivessufficient priority group/groups of data, the receiving device 16 maystart to receive other group/groups of data from the peers or a server14. Once there are sufficient data, the receiving device 16 will resumethe normal receiving operation. The groups may include audio, videoanchor frames, and other video frames (P and B frames). The highpriority groups of data packets may comprise video anchor frames andassociated audio content. The lower priority groups of data packets maycomprise non-anchor frames and associated audio packets.

To ensure that other peers can do a quick channel switch, a number n ofanchor frames are kept in memory at each receiving device 16, eventhough these frames may have already been decoded and displayed by thatreceiving device 16. For example, each receiving device 16 may becapable of buffering 100 seconds of video or more. Depending on thevideo format (e.g., MPEG-2 or MPEG-4), the buffer of the receivingdevice 16 may cache approximately 20-200 anchor frames.

It should be appreciated although the foregoing description of theMediaSwitch feature is described in connection with facilitating aprogram change in an IP environment, the terms “first media contentprogram” and “second media content program” should be understood toinclude any type of media content, including but not limited to live orprerecorded television programs, news programs, movies, concerts, sportsprograms, radio programs, advertising content, television commercials,radio commercials, and the like. Thus, for example, the MediaSwitchfeature may enable not only a switch from one program or type of contentto another, but also a switch from a program to a commercial or viceversa.

MediaShare™

The MediaShare™ feature enables receiving devices to share bandwidth. Ina typical prior art peer-to-peer network as shown in FIG. 4, a group ofusers who share the same file or media stream form a swamp. Theresources are isolated within the group that shares the same file ormedia stream. As shown in FIG. 5, the MediaShare™ feature of the presentinvention enables any peer to be able to participate in one or moreswamps. Accordingly, all the resources on the peer-to-peer network canbe shared among various swamps.

In ADSL and cable modem environments, the upload and download bandwidthare often asymmetric. In an isolated swamp as shown in FIG. 4, theimbalance among the peers will be the burden of the primary server. Forexample, if the stream rate is 1 Mbps, and the download bandwidth forall the peers is 1.5 Mbps and the upload bandwidth for all the peers is0.5 Mbps, and the swamp has four peers, there will be an imbalancebetween the stream rate and the download capabilities of the peers inthe network.

With the MediaShare™ feature of the present invention, the availabilityof real-time media content for upload into the peer-to-peer network isincreased. Each peer in the network with extra resources will be capableof passively participating in other swamps, in order to fully utilizethe available resources of the network.

In an example embodiment according to the present invention, a receivingdevice 16 in the peer-to-peer network (FIG. 5) is receiving anddisplaying one program (e.g., on channel 3). The receiving device 16checks its current upload speed versus its available upload capacity. Ifthe receiving device 16 has available capacity, it will select anotherprogram to receive from a list of programs that are participating on thenetwork. The receiving device will then download the media content fromanother receiving device or server (e.g., on channel 1) that isparticipating on the selected program. The receiving device 16 will thenmake itself available to other receiving devices on the network so thatthose other receivers can download either program from it.

The program data may comprise real-time audio and/or video program data.The list of programs may be all the programs available on the network.The list of programs may comprise selected programs that target aspecific geographic region. The process of selecting another program bythe receiving device 16 may be a random selection process.Alternatively, the process of selecting another program by the receivingdevice 16 may comprise selecting the program that has the least numberof participants.

In order to assure that the data rate of the swamp that the receivingdevice 16 is primarily associated with is not affected by that receivingdevice supporting other swamps, the download speed for data from otherswamps may be limited to a specific rate. For example, the receivingdevice 16 may download the selected program from another swamp at a ratewhich is equal to or less than half of its available upload capacity.

The receiving device 16 may be actively participating in one swamp by,for example, receiving and viewing a television program. This receivingdevice (peer) may then be requested to passively participate in anotherparticular swamp or swamps on the network by downloading programinformation for that swamp or swamps. This request may come from otherpeers on the network 18, from a broadcast device 14 or associatedserver, from the control center 12 (e.g., via Peer Service 38), or begenerated by that receiving device 16 itself.

FIG. 6 is a flowchart illustrating the control of the available networkbandwidth provided by the MediaShare™ feature of the present invention.This control may be implemented by a server or associated broadcastdevice 14 which serves a particular swamp or swamps, or by the PeerService 38 at the control center 12. The server or the Peer Service 38(“controller”) monitors the available upload bandwidth on the network(step 601). Once a determination has been made that there is availableupload bandwidth on the network (step 602), the controller will requesta particular channel to be cached (step 603). The download speed forthis request will be set by the controller (step 604). The controllerwill then identify peers on the network that have available resources tocache blocks or packets of the channel data (step 605). The controllerwill also identify the blocks or data packets to be cached (step 606).The content will be stored at the peers and available for upload byother peers on the network (step 607).

Different levels of service may be provided for in connection with theMediaShare™ service. For example, a free level of service may enablepeers to contribute bandwidth for use on the network. A pay level ofservice may enable a peer to move bandwidth, for example to request aprogram from another peer in the network, or to provide content toanother peer in the network. A subscription level of service may enablebalancing and sharing of bandwidth usage on the network as needed. Otherlevels of service may also be provided which include combined ormodified features of the foregoing levels.

MediaCluster™

The MediaCluster™ feature provides for efficient clustering of the peersto enable optimum network usage. Each user is grouped according to itsIP address. Each of the groups reflect a network (or swamp) which thegroup belongs to. The peer service 38 will forward to each peer in thenetwork a list identifying peers that belong to the same group, as wellas identifying a few peers from other groups. The receiving device 16will limit the number of connections to peers in other groups to thosepeers identified by the peer service 38. MediaCluster enables sharing ofresources mainly between peers connected within the same group, but doesalso permit limited sharing of resources outside of that group, enablingoptimum usage of network resources.

MediaSplice™

The MediaSplice™ feature of the present invention provides for splicingof the video stream for insertion of an advertisement. As shown in FIG.7, MediaSplice™ enables the seamless insertion of a commercial into acompressed digital television stream without touching the compressedvideo stream. The subscriber's viewing behavior is recorded andcategorized during normal channel viewing (step 701). When a commercialspot is approaching, the receiving device 16 will receive instructions(e.g., from the Ad Service 42 of the control center 12) that identifythe corresponding data packets for the commercial which is designatedfor that specific class of viewer and that time slot (step 702). Thereceiving device 16 will download the corresponding packets from acontent or ad server, or from a peer in the network (step 703).Alternatively, the ad or ads may be stored at the receiving device 16.The receiving device will then receive instructions (e.g., from the AdService 42 of the control center 12) for inserting the ad (step 704). Itwill then splice the commercial into the video stream at thecorresponding spot by switching to the ad content (step 705) at thedesignated time. Switching to the ad content may be accomplished in amanner similar to the switch to a different program as discussed abovein connection with the MediaSwitch feature of the present invention.When the commercial(s) are completed, the receiving device will returnto (switch back to) normal viewing of the program (step 706) and waitfor the next instruction for ad insertion.

Each receiving device 16 may store advertising content locally or obtainthe advertising content from an ad server (e.g., advertising service 43and advertising database 44), from a content provider, or from anotherpeer in the network.

MediaOverlay™/MediaSubaudio™

The MediaOverlay™ feature of the present invention enables multiplesubtitles on a single television program, and allows any entity tocreate a subtitle channel independent of the main television program. Inaddition, MediaOverlay™ enables the subtitle channel to be broadcastindependently of the main television program, while being able to bedisplayed in sync with the main television program. The MediaOverlay™process involves a translation service which associates a subtitle withone specific television channel and/or program. This service will beselectable by viewer. The independent subtitle data carries thenecessary timing information which allows it to be synced with theassociated television program at the receiving device 16.

The MediaSubaudio™ feature of the present invention enables multiplesubaudio channels on a single television program, and allows any entitycreate a subaudio channel independent of the main television program.The subaudio channel may be broadcast independent of the main televisionprogram, yet in sync with the main television program. This featureenables language translations of the audio so that viewers can listen toany program in a desired language.

FIG. 8 shows a block diagram of an example embodiment of theMediaOverlay™ and MediaSubaudio™ features. At least some of thereceiving devices 16 may have a translation service 801 associatedtherewith which can be selected by the viewer. The receiving device 16receives the main television program from the server 14 at receiver 56.The decoder 58 decodes and displays the main television program with adelay x. At the same time, the translation service 801 receives anddisplays the main television program at receiver/decoder 802. Atranslation agent 803 (which may be a computer program for translationof audio or text, or a human agent manually translating audio or textand entering such translated data into a database) prepares atranslation of the audio and/or original subtitles into the desiredlanguage selected by the user. If the main television program does notinclude any original subtitle text, the audio may be translated togenerate subtitles in the desired language. A delay x is set at delay804 of the translation service 801. The translated data, which may beeither translated audio or translated subtitles (or both) is thentransmitted to the receiving device 16 via transmitter 805. Thereceiving device 16 receives the translated data at receiver 810. At thereceiving device, the received translated data is decoded andsynchronized with the main television program according to the timestamp at decode device 811.

FIG. 9 is a flowchart of an example embodiment of the MediaOverlay™ andMediaSubaudio™ processes in accordance with the present invention. Theuser selects a channel (step 901). The receiving device 16 obtains thechannel (step 902). The user then selects an available subtitle channelor translation channel for audio and/or subtitle text in a desiredlanguage (step 903). A delay x is set at the receiving device (step904). The selected subtitle data and/or audio translation data is thenreceived, decoded and synchronized with the television program on theselected channel, and overlaid with the main video display of thatchannel (in the case of translated subtitles) or substituted for theoriginal audio of the main television program (in the case of translatedaudio) (step 905).

MediaCrypt™

The MediaCrypt feature of the present invention provides contentprotection demanded by content broadcasters. The video packets foranchor frames are encrypted with a common key. The common keys arefurther encrypted for a specific receiving device 16. The encrypted keythen is delivered to the corresponding receiving device 16. Thereceiving device 16 will decrypt the received anchor frames and combinethe decrypted anchor frames with the rest of the received video framesto reconstruct the compressed video stream. The reconstructed compressedvideo stream can then be decoded within the receiving device 16.

It should now be appreciated that the present invention providesadvantageous methods, apparatus, and systems for delivering mediacontent, such as broadcast television services, over the Internet usingshared bandwidth available from peer-to-peer networking. A broadcastdevice is provided, together with a plurality of receiving devices, aplurality of databases, and a control center. The control centerprovides a number of services, including but not limited to channelcontrol, ad insertion, conditional access, and program guide services.The broadcast device converts real time or non-real time media content,which can be television, radio, and other data received from variouscontent providers, into digital packets. The packets are configured fortransmission over a global communications network, such as the Internet.Each receiving device will request the relevant packets for a desiredprogram or service, decode the received packets, and display the mediacontent contained in the packets on an associated television or othervideo appliance or display. Packets may be received directly from thebroadcast devices or from peers (other receiving devices) on thenetwork.

Although the invention has been described in connection with variousillustrated embodiments, numerous modifications and adaptations may bemade thereto without departing from the spirit and scope of theinvention as set forth in the claims.

What is claimed is:
 1. A system for delivering media content over acommunications network, comprising: one or more servers for deliveringmedia content over the network for one or more media content programs,said media content comprising data packets; a control center forcontrolling delivery of said media content over the network via said oneor more servers; and a plurality of receiving devices for receiving saidmedia content; wherein: at least a portion of said receiving devicesshare resources via the network, enabling a transfer of said datapackets from one receiving device to another; a first receiving deviceis receiving data packets for a first media content program; the controlcenter comprises a peer service; the peer service defines a subset ofsaid receiving devices that comprise peers on the network; a request fora program switch from the first media content program to a second mediacontent program is communicated from said first receiving device to saidpeer service; said peer service provides to said first receiving devicea list of available peers on the network currently receiving datapackets for said second media content program; and said first receivingdevice is enabled to switch to the second media content program byreceiving the data packets for said second media content program fromone of: (a) said one or more servers and at least one of the availablepeers currently receiving the data packets for said second media contentprogram; and (b) the at least one of the available peers currentlyreceiving the data packets for said second media content program.
 2. Asystem in accordance with claim 1, wherein: the media content isreconstructed at the receiving device in real time with data packetsreceived from at least one of: (a) one of said servers; (b) one or moreof the peers on the network; and (c) local memory.
 3. A system inaccordance with claim 1, wherein: said data packets initially receivedfor said second media content program comprise one or more anchor framesfor said second media content program.
 4. A system in accordance withclaim 3, wherein: said one or more anchor frames are received for saidsecond media content program until said first receiving device hassufficient bandwidth to receive data packets containing additionalanchor frames and other types of frames.
 5. A system in accordance withclaim 1, wherein: said data packets initially received for said secondmedia content program comprise one or more anchor frames andcorresponding audio data for said second media content program.
 6. Asystem in accordance with claim 5, wherein: said one or more anchorframes are received for said second media content program until saidfirst receiving device has sufficient bandwidth to receive data packetscontaining additional anchor frames and other types of frames.
 7. Asystem in accordance with claim 1, wherein: said one or more serverscomprise at least one of: (a) one or more dedicated broadcastingdevices; and (b) one or more of said receiving devices.
 8. A system inaccordance with claim 1, wherein: said first receiving devicecommunicates a request for said data packets for said second mediacontent program to one or more of said available peers from said list.9. A system in accordance with claim 8, wherein: said request for datapackets comprises a request for anchor frames from said second mediacontent program.
 10. A system in accordance with claim 9, wherein: anumber of anchor frames are stored at each receiving device for enablingsaid program switch.
 11. A system in accordance with claim 9, wherein:said request includes a request for an initial anchor frame closest to adisplay time of said receiving device.
 12. A system in accordance withclaim 11, wherein: said initial anchor frame is an anchor frame with atime-stamp closest to a time t plus a current time; said time tcomprises one of a positive number, a negative number, and zero.
 13. Asystem in accordance with claim 11, wherein: said initial anchor frameis received, decoded, and displayed regardless of a time stamp for theinitial anchor frame; said first receiving device begins receivingadditional anchor frames after said initial anchor frame is received;and said additional anchor frames are received from said one or more ofsaid peers until said first receiving device has sufficient bandwidth toaccept data packets containing additional anchor frames and other typesof frame.
 14. A system in accordance with claim 1, wherein: said firstreceiving device communicates a stop command to the server or at leastone other of said receiving devices providing said data packets for saidfirst media content program after said program switch is processed. 15.A system in accordance with claim 1, wherein: said one or more serverssegregates said media content into groups of data packets according topriority, including at least a high priority group of data packets and alow priority group of data packets.
 16. A system in accordance withclaim 15, wherein: said high priority group of data packets for saidsecond media content program are provided to said first receiving deviceto enable said program switch.
 17. A system in accordance with claim 16,wherein: said high priority group of data packets comprise anchor framesand associated audio packets; and said lower priority group of datapackets comprise non-anchor frames and associated audio packets.
 18. Asystem in accordance with claim 1, wherein: the one or more serversprovide IP multicasting information and tracking information for thedata packets to all receiving devices requesting the media content; atleast some of the receiving devices requesting the media contentsubscribe to the IP multicasting channel; the data packets are deliveredfrom the one or more servers via IP multicasting of the data packetsover the network; and any receiving devices that one of: (a) fail tosubscribe to the IP multicasting channel; or (b) fail to receive all ofthe data packets for the media content over the IP multicasting channel,use the tracking information to request the data packets from other ofthe receiving devices that have received the data packets.
 19. A systemin accordance with claim 18, wherein: at least one of the receivingdevices creates a new IP multicasting channel; and the at least one ofthe receiving devices transmits the data packets and trackinginformation received from the one or more servers to other of thereceiving devices over the new IP multicasting channel.
 20. A method fordelivering media content over a communications network, comprising:delivering media content provided by one or more servers over thenetwork for one or more media content programs, said media contentcomprising data packets; controlling from a control center delivery ofsaid media content over the network via said one or more servers, thecontrol center comprising a peer service; and receiving said mediacontent at a plurality of receiving devices; wherein: at least a portionof said receiving devices share resources via the network, enabling atransfer of said data packets from one receiving device to another; afirst receiving device is receiving data packets for a first mediacontent program; a request for a program switch from the first mediacontent program to a second media content program is communicated fromsaid first receiving device to said peer service; said peer serviceprovides to said first receiving device a list of available peers on thenetwork currently receiving data packets for said second media contentprogram; and said first receiving device is enabled to switch to thesecond media content program by receiving the data packets for saidsecond media content program from one of: (a) said one or more serversand at least one of the available peers currently receiving the datapackets for said second media content program; and (b) the at least oneof the available peers currently receiving the data packets for saidsecond media content program.
 21. A method in accordance with claim 20,wherein: the media content is reconstructed at the receiving device inreal time with data packets received from at least one of: (a) one ofsaid servers; (b) one or more of the peers on the network; and (c) localmemory.
 22. A method in accordance with claim 20, wherein: said datapackets initially received for said second media content programcomprise one or more anchor frames for said second media contentprogram.
 23. A method in accordance with claim 22, wherein: said one ormore anchor frames are received for said second media content programuntil said first receiving device has sufficient bandwidth to receivedata packets containing additional anchor frames and other types offrames.
 24. A method in accordance with claim 20, wherein: said datapackets initially received for said second media content programcomprise one or more anchor frame and corresponding audio data for saidsecond media content program.
 25. A method in accordance with claim 24,wherein: said one or more anchor frames are received for said secondmedia content program until said first receiving device has sufficientbandwidth to receive data packets containing additional anchor framesand other types of frames.
 26. A method in accordance with claim 20,wherein: said one or more servers comprise at least one of: (a) one ormore dedicated broadcasting devices; and (b) one or more of saidreceiving devices.
 27. A method in accordance with claim 20, wherein:said first receiving device communicates a request for said data packetsfor said second media content program to one or more of said availablepeers from said list.
 28. A method in accordance with claim 27, wherein:said request for data packets comprises a request for anchor frames fromsaid second media content program.
 29. A method in accordance with claim28, wherein: a number of anchor frames are stored at each receivingdevice for enabling said program switch.
 30. A method in accordance withclaim 28, wherein: said request includes a request for an initial anchorframe closest to a display time of said receiving device.
 31. A methodin accordance with claim 30, wherein: said initial anchor frame is ananchor frame with a time-stamp closest to a time t plus a current time;said time t comprises one of a positive number, a negative number, andzero.
 32. A method in accordance with claim 30, wherein: said initialanchor frame is received, decoded, and displayed regardless of a timestamp for the initial anchor frame; said first receiving device beginsreceiving additional anchor frames after said initial anchor frame isreceived; and said additional anchor frames are received from said oneor more of said peers until said first receiving device has sufficientbandwidth to accept data packets containing additional anchor frames andother types of frame.
 33. A method in accordance with claim 20, furthercomprising: communicating a stop command from said first receivingdevice to the server or at least one other of said receiving devicesproviding said data packets for said first media content program aftersaid program switch is requested.
 34. A method in accordance with claim20, wherein: said one or more servers segregates said media content intogroups of data packets according to priority, including at least a highpriority group of data packets and a low priority group of data packets.35. A method in accordance with claim 34, wherein: said high prioritygroup of data packets for said second media content program are providedto said first receiving device to enable said program switch.
 36. Amethod in accordance with claim 35, wherein: said high priority group ofdata packets comprise anchor frames and associated audio packets; andsaid lower priority group of data packets comprise non-anchor frames andassociated audio packets.
 37. A method in accordance with claim 20,wherein: the one or more servers provide IP multicasting information andtracking information for the data packets to all receiving devicesrequesting the media content; at least some of the receiving devicesrequesting the media content subscribe to the IP multicasting channel;the data packets are delivered from the one or more servers via IPmulticasting of the data packets over the network; and any receivingdevices that one of: (a) fail to subscribe to the IP multicastingchannel; or (b) fail to receive all of the data packets for the mediacontent over the IP multicasting channel, use the tracking informationto request the data packets from other of the receiving devices thathave received the data packets.
 38. A method in accordance with claim37, wherein: at least one of the receiving devices creates a new IPmulticasting channel; and the at least one of the receiving devicestransmits the data packets and tracking information received from theone or more servers to other of the receiving devices over the new IPmulticasting channel.